Intuitive Real-Time Control of Spectral Model Synthesis
نویسندگان
چکیده
Several methods exist for manipulating spectral models either by applying transformations via higher level features or by providing in-depth offline editing capabilities. In contrast, our system aims for direct, full, intuitive, real-time control without exposing any spectral model features to the user. The system extends upon previous machine learning work in gesture-synthesis mapping by applying it to spectral models; these are a unique and interesting use case in that they are capable of reproducing real world recordings, due to their relatively high data rate and complex, intertwined and synergetic structure. To achieve a direct and intuitive control of a spectral model, a method to extract an individualized mapping between Wacom Pen parameters and Spectral Model Synthesis frames is described and implemented as a standalone application. The method works by capturing tablet parameters as the user pantomimes to synthesized spectral model. A transformation from Wacom Pen parameters to gestures is obtained by extracting features from the pen and then transforming those features using Principal Component Analysis. Then a linear model maps between gestures and higher level features of the spectral model frames while a k-nearest neighbor algorithm maps between gestures and normalized spectral model frames.
منابع مشابه
The Timbre Engine - Progress Report
The Timbre Engine is a software synthesizer that operates on a set of controls and algorithms developed on a model of the additive synthesis parameters. It provides a real-time additive engine, a novel graphical user interface, the interfacing between them and control by a MIDI keyboard. The system has been built on an object oriented architecture designed to provide the necessary functionality...
متن کاملReal-time Noise Synthesis with Control of the Spectral Density
We propose in this paper a spectral synthesis model to generate noisy sounds with independent control parameters for spectral density and spectral envelope. Algorithms defining in a efficient way these spectral properties from the statistical parameters of the model are presented in details. Real-time implementation is composed of many methods which can be sequenced.
متن کاملBand-Limited Simulation of Analog Synthesizer Modules by Additive Synthesis
Analog synthesizers continue to be used by many musicians because of their distinctive timbres, intuitive real-time control and flexible patching. There has been recent interest in simulating the analog signal chain with digital techniques. However, a literal time-domain translation of analog VCOs and VCFs is surprisingly challenging. This paper presents a new strategy for digital simulation ba...
متن کاملRealtime Musical Applications using FFT based Resynthesis
The Fast Fourier Transform (FFT) is a powerful general-purpose algorithm widely used in signal analysis. FFTs are useful when the spectral information of a signal is needed, such as in pitch tracking or vocoding algorithms. The FFT can be combined with the Inverse Fast Fourier Transform (IFFT) in order to resynthesize signals based on its analyses.This application of the FFT/IFFT is of great in...
متن کامل